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VISION BEYOND TOMORROW 


Introduction 


This document describes work intended to aid in the problem of automatically registering two images of 
dissimilar type. This work was performed under NASA contract number NAS5-32357. It was performed 
by Sridhar Srinivasan, Carl Stevens, Les Elkins, Radha Poovendran, and Srinivasan Raghavan,. 


Registration Algorithms as Implemented in mist Code 

The algorithms implemented in this software attempt to determine a transformation from one image to 
another. The registration software can be used to register similar or dissimilar multi-sensor imagery as long 
as the transformation between this imagery is restricted to rotation, translation, and scaling (collectively 
known as a “similarity transformation”). This composite transformation can be expressed as: 




COS# 

-sin# 


sin # x 
cos# y 


where: 

(jc *y) is the transformed point in the second image, image2, corresponding to (x,y) in the first 
image, imagel, 

s is the common scale by which imagel was expanded to create image2, 

T„ T y are the units that imagel was translated in the x and y axes, 

0is the angle by which imagel was rotated, and 
(x,y) is the source point in the original image. 


The algorithms which determine the scale, translation, and rotation of the two images are based on lines 
extracted from the original images. By working with these lines rather than the images themselves, the 
algorithm can deal with differing types of imagery (visible, IR, AVHRR, etc.). 

The algorithm performs five steps: 

• Extract edges from image files, 

• Extract line segments from edges, 

• Determine rotation parameter based on lines segments, 

• Determine scale parameter based on line segments, and 

• Determine translation parameter based on line segments. 

Each of these will be dealt with in greater detail below. 
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For more information on mist and related products and services, please contact 

LNK Corporation, 

6811 Kenilworth Avenue, Suite 306 
Riverdale, MD 20737, USA 
Phone: (301) 927-3223 
FAX: (301)927-7193 
email: info@lnk.com 

Visit LNK’s web site on the internet at http://www.lnk.com 


RESTRICTED RIGHTS LEGEND 

Use, duplication, or disclosure by the Government is subject to restrictions as set forth in 
subparagraph (c)(l)(ii) of the Rights in Technical Data and Computer Software clause at 
DFARS 252.227-7013 or FAR 52.227-14, as applicable. 
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Edge Extraction 


The quality of edges obtained using any given edge detection technique is very critical to the output of the 
line extraction algorithm. The desirable features in an edge detection algorithm therefore include: 


• High detection rates: The probability of missing a valid edge should be low. The probability 
of falsely identifying a nonexistent edge should be low as well. The probability of false 
alarms, as well as the probability of a missed edge, are both monotonically decreasing 
functions in terms of the signal-to-noise ratio. If the noise is assumed to be Gaussian, the 
probability of a false alarm is given by the complementary error function, and the probability 
of detection is the same function shifted by the square root of the signal to noise ratio. Hence 
the property of high detection is equivalent to maximizing the signal to noise ratio for a given 
detector. 


• Localization of edges: The estimated edge points should be as close as possible to the true 
edge points. 

• Uniqueness of the edge: The solution to the coordinates of the edge point should be unique at 
every point. 


Canny 1 showed that the solution to these three constraints leads to a linear match filter. From numerical 
optimizations, Canny also noted that an efficient approximation to the edge function is the derivative of the 


Gaussian, 


G(;t) = exp 


2 \ 


2 <T 2 


where x is the location of the edge and o is the standard deviation of the Gaussian function. 

To produce the list of valid edges, the code does the following: 

• Computes the separable Gaussian functions in the x and y directions. 

• Computes the image gradient. 

• Convolves the image gradient with the gradient of the Gaussian. 

• Generates the edge map by starting at points above a “high” threshold, and connecting to the 
points that are above the “low” threshold (in this implementation, “high” is 255 fully 
activated, and “low” is one or greater). 


Line Segment Extraction 

Once the edges are extracted, they must be converted into lines. This is done by grouping valid edge points 
that lie along lines and creating line segments. Valid lines are determined by edge density and line length. 


1 Canny, J., “A Computational Approach to Edge Detection,” IEEE Transactions on PAMI, Vol. 8, No. 6, 
November 1986, pp. 679-698 
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This method generates many valid line segments, but will also generate a number of spurious ones. 
Inclusion of these segments in the parameter estimation algorithms will skew the estimated transformation 
parameter values. It is therefore necessary to use thresholding operations which will eliminate as many 
spurious line segments as possible. The current version of the code picks rather permissive parameters, 
which nonetheless keeps the algorithm from generating many of the very small lines. 

The algorithms used in the following sections contain code that will increase in computational cost greatly 
as the number of lines used increases. Thus once the lines are generated, it is still desirable to further 
reduce their number. This is done by choosing a minimum length threshold based on an examination of the 
histogram. The threshold chosen by the code as it stands now is the value one quartile from the lowest 
value, thus three quarters of the lines remain after this additional restriction. 


Determination of the Rotation Parameter 


Given a set of lines from each image of the pair, we wish to determine the rotation angle needed to rotate 
the lines in one image to those in the second. This requirement is complicated by the fact that there may not 
be a high degree of correspondence between the two sets of lines, and by the possibility that the two sets of 
lines are at different scales and may be shifted spatially. It is therefore desirable to use techniques based on 
histogram solutions, which will give us the maximum likelihood solution for the parameter estimation 
problems at hand. 

The first step in computing the rotation is to determine the direction of each line. The direction is given as 
the angle with respect to the x axis, and is constrained to be between anc ® * Then, for each line 

in the first image, the difference in angle to each line in the second image is computed. This then gives us a 
list of the difference in direction between all lines in the first file to all lines in the second file. While in 
practice the images we have used have contained a manageable number of lines, note that the number of 
values stored (number of lines above threshold length in image one times number of lines above threshold 
in image two) can get very large, and it may be desirable to increase the length threshold for some images. 

To analyze this list, we perform a histogram analysis of the difference values. Since in the problem domain 
we are examining implies that we have at least coarse correspondence between the image pair, we typically 
assume that the rotational angle between the two images is between -10 degrees and +10 degrees. This 
default can be overridden to look for rotational correlation over larger angles. We can then build our 
histogram accordingly, ignoring angle differences outside these bounds. 

The optimum number of bins in the histogram is a function of the desired accuracy (which implies a small 
bin size, and thus a large number of bins) and the amount of data to be examined (with sparse data, bin sizes 
too small might not be filled adequately, and thus might give spurious results, implying the need for a small 
number of bins). In this implementation, 100 bins are used, giving a bin size of 


l0 ~ (~ l0 ) . 0 .2 

100 

degrees per bin. 

The histogram is then filtered by two passes with a (1,2,1) mean filter, and the angle value corresponding to 
the bin with the maximum number of entries is chosen as the rotational value. The set of lines 
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corresponding to the second image is then rotated by the negative of this determined value for further 
processing. This rotation is performed about the center of the image. 


Determination of the Scale Parameter 


Even though lines are robust enough to use as features, some line segments in each image may be broken or 
missing altogether due to various reasons (noise, poor contrast, etc.). Hence simple examination of the ratio 
of scales of corresponding lines (as we examined the angles of corresponding lines above) is insufficient to 
give good results. The method implemented in this project composes the given lines into triangles, and 
determines the ratio of the area of the triangles in the first image to the triangles in the second image. 


To form the triangles, the list of lines is exhaustively searched. To find a potential triangle from the first 
image, three lines from that image, 11, 12, and 13, are chosen such that their directions differ from each other 
by more than some angle tolerance 8. In the current implementation, 8 is 25 degrees. This prevents 
excessively slivered triangles from being considered, as they would have a small area which might skew the 
results. Note that we are not looking for actual triangles in the line segments, but rather lines which can be 
extended to form triangles for consideration. To find a corresponding triangle in the second image, we find 
lines 11% 12% and 13’ such that 11% 12% and 13’ have directions greater than 8 degrees apart, and which 
additionally fulfill the requirement that each corresponding line in the two triangles is within some tolerance 
p: that is, the direction of 11 and II’ differ by less than p degrees, 12 and 12’ differ by less than P degrees, 
and 13 and 13’ differ by less than p degrees, p defaults to ten degrees in the current implementation. Note 
that for any triangle in the first image there may be several in the second image that fulfill these 
requirements. 


Once two sets of lines are found, the area of the triangles they represent must be determined. This is 
computed by a determinant: 


1 



y* 


i i 


*2 * 3 | 


?2 >3 


A =^i x iy^~ x ^2 + x ^y\- x \y^ + x \y7- x iy\) 


where (xj, yO, (x 2 , y 2 ), and (x 3 , y 3 ) are the coordinates of the vertices of the triangle. This computation is 
performed for both triangles. Since the x andy axes in the second image are scaled by s, a triangle from the 
first image with area A should have a corresponding triangle in the second image with an area roughly equal 
to s 2 A. Thus the square root of the ratio of a triangle’s area in the second image to the area of a 
corresponding triangle in the first image will be the scale factor between these triangles. Note that since this 
computation depends on the triangle’s area only, it is invariant with respect to both translation and rotation. 
Also, since particularly small areas in the denominator can skew the results, we ignore small triangles. 

With this computation performed on the large number of corresponding triangles present in an image, then a 
large number of ratios will be available in a list. We then perform histogram analysis as we did in the case 
of rotation to determine the most common scaling factor, except the histograms are built in log space. This 
factor is then used to invert the scaling in the line list from the second image, in order to obtain a true 
translation estimation, as described next. 
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Determination of the Translation Parameter 

To find the translation parameters, the algorithm again builds a list of triangles as in the scaling code, this 
time using the derotated and descaled lines. The centroid of each triangle is generated by: 

+*2 +*3>”Cyi + ^ + ySj 

A list is then generated of all possible translations between the centers of corresponding triangles. Again 
using histogram methods, we determine the jc and y values that occur the maximum number of times in the 
range of interest. These are the translation values, T x and T y . 


With all four parameters now known, the code performs the transformation on the second image to rotate, 
scale, and translate it to correspond to the first. 
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C Code Function Description 


This section describes the function names in the C code and the parameters they take and return. In most 
cases, the algorithms have been discussed in the previous section. 


register Jmages 


register_images makes the calls to the supporting routines to perform the line identification and 
correlation. 


void register_images ( 


char 

*inl , 

/* 

char 

*in2 , 

/* 

char 

*out , 

/* 

float 

sigma. 

/* 

float 

min segment, 

/* 

float 

max^distance, 

/* 

float 

thresh. 

/* 

float 

rotation range, 

/* 

float 

scale range, 

/* 

float 

shif t_range 

/* 


) 


primary input file name (pgm file) */ 
secondary input file name (pgm file) */ 
output file name (pgm file) */ 
sigma for canny edge detection */ 
minimum length of poly-line segment */ 
max. distance of poly line from edge */ 
min. line length considered */ 
range of {+/-) permissible rotation */ 
range of scales in percent (+/-) 100 */ 
range of shifts in pixels */ 


These parameters are primarily passed to the supporting functions. If a zero is passed for any of the 
numeric parameters, then default values will be chosen. This function also computes the desired minimum 
line length if it is passed a zero for thresh (it chooses the value one quartile into the sorted list of lengths). 


compare 

compare defines a comparison function for two pointers to floating point values. This function is used 
from C’s built in qsort function. 

int compare (const void *a, const void *b) 

This function is not intended to be directly called by the user. 


compute_rotation 


compute_rotation determines the rotation offset between two sets of lines. 

float compute_rotation ( float *angl, /* Array of angles for lines in first image */ 

float *ang2, /+ " " " " " " second " */ 

int dlengthl , /* Number of lines from first image. */ 

int dlength2 , /* " second " */ 

float *lengthl , /* Length of lines from first image. */ 
float *length2 , /* ” " " " second " */ 

float thresh, /* Minimum line length considered. */ 
float range) /* Max number of degrees rot. considered */ 

The number returned is the rotation angle (in degrees). 
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derotate 


derotate performs the derotation. 


void derotate (rectlist *indata, 
rectlist *outdata, 
int dlength, 
float rotation) 


f* Input line endpoint list. */ 

/* Destination {rotated) line endpoint list. */ 
/* Number of lines in the list. */ 

/* Degrees to rotate the line list. */ 


Note that the rotation is performed with respect to the center of the image (so the endpoints are translated by 
(-1/2 xsize, -1/2 ysize) before rotation, then translated back by the same amount before storage). 


differs 


differs compares two floating point numbers (angles in degrees). 

int differs (float degl, 
float deg2) 

The function returns one (true) if they are greater than some number of degrees from each other, and zero 
(false) if they are not. The difference threshold is defined in the routine as a constant, and is 25 in the 
current implementation. This function also deals with wraparound. If it compares, for example, line 
segments with angles 2 degrees and 178 degrees, it will treat them as differing by 4 degrees rather than 176. 


is_close 

is_close compares two floating point numbers (angles in degrees). 

int is_close (float degl, 
float deg2) 

The function returns one (true) if they are within some number of degrees of each other, and zero (false) if 
they are not. The difference threshold is defined in the routine as a constant, and is 10 in the current 
implementation. This function also deals with wraparound, so if it compares, for example, line segments 
with angles 2 degrees and 178 degrees, it will treat them as differing by 4 degrees rather than 1 76. 


compute_param 


compute_param takes a list of line endpoints and computes the angle and length of each segment. 


void compute_param (rectlist *data, 
int dlength, 
float *length, 
float *ang, 
float *cosx, 
float *sinx. 


/* Input line endpoint list. */ 

/* Number of line segments. */ 

/* Returned segment lengths. */ 

/* Returned segment angle (direction) . * / 

/* Returned cosine value of angle. */ 

/* Returned sine value of angle. */ 
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float *px) 


/* px contains x sin ang - y cos of ang */ 


This routine computes a number of numeric values for later use, as indicated above. 


rescale 


rescale will rescale the line endpoints given the data given a scaling factor. 

void rescale (rectlist *indata, /* Input line endpoint list. */ 
rectlist *outdata, /* Output line endpoint list. */ 
int dlength, /* Number of line segments. */ 

float scale) /* Scale multiplier. */ 

The endpoint values are scaled about the origin. 


Intersection 


intersection will compute the intersection between the two lines specified. 

float *intersection (float sinl, /* sine of angle of first line */ 

float co si/ /* cosine of angle of first line */ 

float pi, /* intercept representation of first line */ 

float sin2 , /* sine of angle of second line */ 

float cos2 , /* cosine of angle of second line */ 

float p2 ) /* intercept representation of second line */ 

While the use of sine and cosine for each angle overspecifies the line, these numbers have already been 
calculated and stored, so it is more efficient to use both. It returns the x and y values of the intersection. 


max^smooth 

max_smooth takes a histogram of values, and returns the maximum histogram bin with the maximum value 
after smoothing. 

int max smooth (int *hist, /* The histogram array. */ 

int n) /* The number of histogram elements. */ 

The code implements a 1-2-1 filter twice (that is, h n = h n _ x + 2h n + h n+x ) before choosing the maximum 
value. 


compute_scale 


compute_scale computes the scale between two sets of lines. 
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float compute_scale { rectlist *datal, /* 


rectlist *data2. 

/* 

int dlengthl. 

/* 

int dlength2 , 

/* 

float 

* lengthl , 

/* 

float 

*length2 , 

/* 

float 

*cosl. 

/* 

float 

*cos2. 

/* 

float 

*sinl , 

/* 

float 

*sin2, 

/* 

float 

* P 1 * 

/* 

float 

*p2, 

/* 

float 

*dirl , 

/* 

float 

*dir2. 

/* 

float 

thresh, 

/* 

float 

range ) 

/* 


First line endpoint list. */ 

Second line endpoint list. */ 

Number of segments in first line. */ 
Number of segments in second line. */ 
First segment lengths. */ 

Second segment lengths. */ 

First lines* cosine value of angle. */ 
Second lines* cosine value of angle. */ 
First lines' sine value of angle. */ 
Second lines' sine value of angle. */ 
Contains x sin of ang - y cos of ang */ 
Contains x sin of ang - y cos of ang */ 
Second line's direction. */ 

Second line's direction. */ 

Minimum line length considered. */ 

Scale difference considered. */ 


The number returned is the scale factor in percent (100.0 is no scaling). 


compute_shift 


compute_shift computes the x and y translation between sets of lines. 


float compute_shif t ( float *retval, 

rectlist *datal, 
rectlist *data2, 
int dlengthl, 
int dlength2, 
float *lengthl, 
float *length2, 
float *cosl, 
float *0032, 
float *sinl, 
float *sin2, 
float *pl, 
float *p2, 
float *dirl, 
float *dir2, 
float thresh, 
float shift_range) 


/* Return val: [0] is x, [13 is y. */ 

/* First line endpoint list. */ 

/* Second line endpoint list. */ 

/* Number of segments in first line. */ 

/* Number of segments in second line. */ 

/* First segment lengths. */ 

/* Second segment lengths. */ 

/* First lines* cosine value of angle. */ 
/* Second lines' cosine value of angle. */ 
/* First lines' sine value of angle. */ 

/* Second lines' sine value of angle. */ 

/* Contains x sin of ang - y cos of ang */ 
/* Contains x sin of ang - y cos of ang */ 
/* Second line's direction. */ 

/* Second line ' s direction . */ 

/* Minimum line length considered. */ 

/* Translational difference considered. */ 


The translation values are returned in retval. 


image clear 

image clear clears the elements of the image data structure for later use. 

void image clear (image *in) /* in is a pointer to an image data type. */ 


image free_ char 


image free_char frees the space allocated to an image with the image allocate_char routine. 
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void 


/* Image pointer. */ 
**ucmatrix) /* data pointer. V 


image free_char (image *in, 

unsigned char 

image a!locate_char 

image alIocate_char allocates a 2d matrix of characters. 

unsigned char **image allocate_char {int cc, /* Number of columns... */ 

int rr) /* Number of rows. */ 

The function returns a pointer to the area allocated. 

image allocate float 

image allocatejloat allocates a 2d array of floating point storage. 

float **image allocate_f loat (int cc, /* Number of columns... */ 

int rr) /* Number of rows.... */ 

The routine returns a pointer to the allocates space. 

image write_pnm 

image write_pnm writes a pnm format graphics file. 

int image_ write_pnm (image *in, /* Image file to write. */ 

char *str) /* Filename. */ 

The routine returns zero (false) if it cannot write the file, true otherwise. 

image read_pgm_header 

image read ppm header examines the header of a pgm (portable greymap) format graphics file. 

int image read_pgm_header (FILE *fp, /* File pointer to the (open) file. */ 

int *cc, /* Pointer to returned num of columns. */ 

int *rr, /* Pointer to returned num of rows. */ 

int *ncol) /* Pointer to returned num of colors. */ 

The routine returns zero (false) if it cannot read the file header, true otherwise. It also indicates the number 
of columns, rows, and colors in the image through the pointers passed to it. 
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image read_pgm_image 


image read pgm image reads the data in a pgm image. 

int image read_pgm__image (image *in, /* Pointer to the image data structure. */ 

char *str) /* Pointer to the filename. */ 

The routine returns zero (false) if it cannot read the file, true otherwise. The actual data is returned in the 
image data structure. 


image alloc 


image alloc allocates the memory needed to read the image data in. 


int image alloc (image *in, /* Pointer to the image data structure. */ 

int nc, /* Numnber of colors in the image. */ 

int cc, /* Number of columns in the image.*/ 

int rr) /* Number of rows in the image.*/ 

This routine modifies the image data structures. 


image read 


image read is a wrapper to perform the read. It prints out an informational message in the process. 


int image read (image *in, 

char *str) 


/* Pointer to the image data structure. */ 
/* Pointer to the filename. */ 


image free 

image free frees the allocated memory associated with the image in question. 

void image free (image *in) /* Pointer to the image data structure. */ 


image follow 


image follow follows a connected edge. 


int image 


follow(int i, /* 

int j, /* 

int low, /* 

int cols, /* 

int rows, /* 


unsigned char 
unsigned char 


location */ 
location */ 

Low threshold */ 

Cols in image */ 

Rows in image */ 

**data, /* Keeps track of visited points. 
**mag) /* Gradient data (I think) . */ 


*/ 
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This is a recursive routine, called by image canny. It attempts to look around in an area and track 
adjacent points. 


image canny 

image canny performs Canny edge detection. This code is modified from the shareware developed by 

the Robot Vision Group, University of Edinburgh, U.K. by Bob Fisher, Dave Croft and A Fitzgibbon. The 
modifications were made to allow it to work in our environment. 

void image canny (image *in, /* Original image. */ 

float s) /* Threshold sigma parameter. */ 

The results are stored in the image. 


image thin 


image thin is a thinning algorithm for binary images. See ‘Image Processing’ by Anil K Jain (p383) for 

details. 


void image thin (image *in) /* in is the (binary) image in question. */ 


image split 


image split is a split function for fitting poly-lines to a list 

int image split (LIST *in, 

int n, 

LIST * out t 
float *d_array, 
float max dist) 


The routine is called from image_trace, and is recursive. 


image trace 


image trace is used to find lines. 

int image trace (image *img, 

LIST *list , 
int *listlength / 
int xO, 
int yO, 

float max_dist) 


It is used by image r2v to convert to find the lines in an image. 
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image r2v 


image r2v performs the raster to vector conversion. 

int image r2v {image *in, /* image w/pixel val of 0/1 for edge presence) 

float in seg, /* Minimum segment threshold. */ 

float in~dist, /* Maximum distance for thresholded points. */ 

rectlist *rlptr, /* The line segment endpoints. */ 

int maxi) /* Maximum number of lines. */ 

The routine returns the number of lines identified in the image. The line data is returned in rlptr. 
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Sample Results 


Performance Summary 

The following table documents the algorithm’s results on several image pairs. 


Original Image 

Second Image 

Perceived 

Rotation 

Perceived 

Scaling 

Perceived 

Translation 

orthol.pgm 

ortho l_r7.pgm 

anti, 7.40 

99.50% 


orthol r7.pgm 

orthol.pgm 

7.20 i 

100.50% 

0.0.-0.8 

orthol.pgm 

ortho l_s95. pgm 

0.20 

94.06% 

0.8, 4.0 

orthol s95.pgm 

orthol.pgm 

anti, 0.40 

106.31% 

0.0, -4.0 

orthol.pgm 

ortho l_t26.pgm 

anti, 0.20 

100.10% 

26.4,-25.6 

orthol t26.pgm 

orthol.pgm 

anti,0.20 

100.10% 

-25.6,22.4 

orthol.pgm 

ortho 1 _r7_s95 .pgm 

anti, 7.00 

99.50% 

-20.8,-0.8 

orthol r7 s95.pgm 

orthol.pgm 

7.00 

100.50% 

16.8,8.0 


ortho I_r7_tl0.pgm 

anti, 7.4 

99.30 

-4.8,12.8 

ortho l_r7_t lO.pgm 

orthol.pgm 

7.20 

102.95% 

2.4, -12.8 

orthol.pgm 

ortho 1 _s95_t 1 0 . pgm 

0.20 

94.44% 

-11.2,12.8 

orthol s95_tl0.pgm 

orthol.pgm 


105.88% 

11.2,-12.8 

1 


orthol_r7_s95_t20.pgm 

anti,7.0 

96.16% 


3 

i 

t20.pgm 

Orthol. pgm 

6.8 

102.54% 

1 28.8,-16 1 


Figure 1 Table of Results 


Note that *anti’ rotation is counterclockwise. 


Image sources: The original image is orthol.pgm, a 1024x1024 image taken from a grayscale orthophoto 
obtained from the USGS. The image of an area in Carderock, Maryland, and is 2 meters per pixel. All 
other comparison images were generated by the noted transformations: 

ortho l_r7.pgm: orthol rotated 7 deg, boundaries clipped and filled by pasting representative image 
data into the areas left uncovered by the rotation., 
ortho l_s95. pgm: orthol scaled to 95% of original size, black (non-filled) boundaries, 
ortho l_t26.pgm: orthol translated by (26,26), empty area filled. 

ortho I_r7_s95.pgm: orthol rotated 7 deg, then scaled by 0.95; boundaries clipped and filled, 
ortho 1 _r7_t 1 0 . pgm : orthol rotated 7 deg, then translated by (10,10); boundaries clipped and filled, 
ortho l_s95_t 10. pgm: orthol scaled by 0.95, then translated by (10,10), boundaries clipped and 
filled. 

orthol_r7_s95_t20.pgm: orthol rotated 7 deg, then scaled by 0.95, then translated by (20,20); 
boundaries clipped and filled. 


Note that most of the results are reasonable. One of the exceptions is the case where the comparison image 
was orthol_r7_s95.pgm. In this case, the rotation was found accurately, but the scaling was not. Curiously, 
when this image was then translated as in ortho I_r7_s95_t20. pgm, the perceived scaling values were much 
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better. Examination of the histograms of relative ratio of areas between the triangles used for scale 
determination indicates that in this set of images, the ‘correct’ scale is not greatly higher than the nearby 
scales. Additionally, in the images ortho I_r7_s95_t20.pgm and ortho I_r7_s95.pgm the boundaries created 
by the transformation were filled in by hand separately in each case. Several lines were found in the hand- 
drawn areas in the non-translated image that were not present in the translated image, and these contributed 
to the ratio of areas enough to skew the results to a different histogram bin. 
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Detailed Summary 

In this section, the intermediate results from a single pair of images are presented. 



Figure 2 First source image: orthol.pgm 


The first image, orthol.pgm, is taken from a larger USGS orthophoto. 
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Figure 3 Edges in first image 


The above figure shows the edges detected by the Canny operation on the first source image. 
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Figure 4 Lines detected in ortho l.pgm 

The lines detected in the first source image are shown above, overlaid on the original. The lines that are 
below threshold are colored red, and the lines used are in green. 
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Figure 5 Second source image: ortho I_r7_s95_t20.pgm 

The above image is the second source used for this test. It is a rotated, translated, and scaled version of the 
original, with cloned trees filling in the areas around the edges created by shrinking and scaling the original. 
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Figure 6 Edges detected in second image 


The above figure shows the edges detected by the Canny operation on the first source image. 
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Figure 7 Lines detected in second image 


The lines detected in the second source image are shown above, overlaid on the original. The lines that are 
below threshold are colored red, and the lines used are in blue. 
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Figure 8 Lines from both images 


The lines from both images are shown together in the above image (green for the first image, blue for the 
second). Only line lengths above the threshold are shown. 
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Angle Difference In Degrees 

Figure 9 Angle Difference Histogram 

The above figure shows the smoothed histogram of angle difference values. Based on the peak value in the 
bin at -7, this value was chosen to be the rotational angle between images. 
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Figure 10 Lines from both images after derotation 


The lines from both images are shown again, after the lines in the second image (blue) are rotated to remove 
the rotational difference between the two images. 
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Figure 11 Scale Difference Histogram 


The above figure shows the smoothed histogram of relative scales of the triangles. Based on the peak value 
in the bin at 96.16%, this value was chosen to be the scale factor between images. 
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Figure 12 Lines from both images after descaling 


The line pairs are shown above after compensation for the second image’s scaling factor. 


This data is delivered with limited and restricted rights by LNK Corporation Inc. (1997) 

26 



400000 


350000 


300000 


E 250000 


200000 


150000 


^ 100000 


mm 


CN oo 

ro ro CM CXI 

till 


X Translation Differenced Between Triangles 

Figure 13 Translation Values in X 

The above figure shows the smoothed histogram of the translation values in the X axis between the set of 
triangles. Based on the peak at -22.4, this value was chosen to be the translation on the X axis. 
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Figure 14 Translation Values In Y 

The above figure shows the smoothed histogram of the translation values in the Y axis between the set of 
triangles. Based on the peak at 23.2, this value was chosen to be the translation on the Y axis. 
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Figure 15 Lines from both images after detranslation 

The above image shows the lines after removing the translation factors determined by the program. 
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Figure 16 Second image transformed to correspond to first 


The above image shows the final result of the process: the second image transformed such that it 
corresponds to the first image. 
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Figure 17 Difference image of result and orthol.pgm 


The difference image between the original and output images is shown above (where white is no difference, 
black is maximal difference). The areas of maximum difference are the regions in the output image that 
mapped to areas outside the original second image, and so were colored black. 
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